Skip to content

libtensorflow: 2.13.0 -> 2.14.0#272838

Open
zeuner wants to merge 4 commits intoNixOS:masterfrom
zeuner:tensorflow-2-14
Open

libtensorflow: 2.13.0 -> 2.14.0#272838
zeuner wants to merge 4 commits intoNixOS:masterfrom
zeuner:tensorflow-2-14

Conversation

@zeuner
Copy link
Contributor

@zeuner zeuner commented Dec 8, 2023

Description of changes

Updated the version and adapted scripts and patches to make it build. Basic tests also succeeded. There remains a warning about ml_dtypes, which might be expected (see #258546 (comment))

Things done

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

Add a 👍 reaction to pull requests you find important.

@github-actions github-actions bot added the 6.topic: python Python is a high-level, general-purpose programming language. label Dec 8, 2023
@GaetanLepage
Copy link
Contributor

Thank you for this work @zeuner !
About ml_dtypes, maybe you could directly go for 2.15.0 ?

@zeuner zeuner force-pushed the tensorflow-2-14 branch 2 times, most recently from f2ee916 to ae92fdd Compare December 8, 2023 10:52
@zeuner
Copy link
Contributor Author

zeuner commented Dec 8, 2023

About ml_dtypes, maybe you could directly go for 2.15.0 ?

In the process of doing so. When I saw 2.15.0, I had already started working on 2.14.0, so I decided to finish it first in order to get all the clang-related changes right. Hope to get it adapted to 2.15.0, soon.

@GaetanLepage
Copy link
Contributor

In the process of doing so. When I saw 2.15.0, I had already started working on 2.14.0, so I decided to finish it first in order to get all the clang-related changes right. Hope to get it adapted to 2.15.0, soon.

Very cool !

@ofborg ofborg bot requested a review from abbradar December 8, 2023 12:48
@ofborg ofborg bot added 10.rebuild-darwin: 0 This PR does not cause any packages to rebuild on Darwin. 10.rebuild-linux: 11-100 This PR causes between 11 and 100 packages to rebuild on Linux. labels Dec 8, 2023
@zeuner zeuner force-pushed the tensorflow-2-14 branch 3 times, most recently from 42cfe4d to fa0d054 Compare December 10, 2023 12:53
@zeuner zeuner marked this pull request as draft December 11, 2023 21:51
@zeuner zeuner force-pushed the tensorflow-2-14 branch 7 times, most recently from bb38de2 to d50895a Compare December 17, 2023 01:59
@zeuner zeuner force-pushed the tensorflow-2-14 branch 3 times, most recently from 0a53960 to 5b66a10 Compare December 25, 2023 13:33
@ofborg ofborg bot added 8.has: package (new) This PR adds a new package 10.rebuild-darwin: 11-100 This PR causes between 11 and 100 packages to rebuild on Darwin. and removed 10.rebuild-darwin: 0 This PR does not cause any packages to rebuild on Darwin. labels Dec 28, 2023
@zeuner zeuner mentioned this pull request Jan 4, 2024
13 tasks
@ofborg ofborg bot added 10.rebuild-darwin: 11-100 This PR causes between 11 and 100 packages to rebuild on Darwin. 10.rebuild-linux: 11-100 This PR causes between 11 and 100 packages to rebuild on Linux. and removed 10.rebuild-darwin: 101-500 This PR causes between 101 and 500 packages to rebuild on Darwin. 10.rebuild-linux: 101-500 This PR causes between 101 and 500 packages to rebuild on Linux. labels Nov 1, 2024
@boltzmannrain
Copy link
Contributor

On my machine nix-build --system aarch64-linux -A python311Packages.tensorflowWithCuda fails with

ERROR: /build/source/third_party/py/numpy/BUILD:5:6: //third_party/py/numpy:numpy depends on @pypi_numpy//:pkg in repository @pypi_numpy which failed to fetch. no such package '@pypi_numpy//': whl_library pypi_numpy failed: Collecting numpy==1.26.4 (from -r /build/tmparr9phrh (line 1))
  Downloading numpy-1.26.4-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (14.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.2/14.2 MB 5.9 MB/s eta 0:00:00
 (ERROR: THESE PACKAGES DO NOT MATCH THE HASHES FROM THE REQUIREMENTS FILE. If you have updated the package versions, please update the hashes. Otherwise, examine the package contents carefully; someone may have tampered with them.
    numpy==1.26.4 from https://files.pythonhosted.org/packages/79/ae/7e5b85136806f9dadf4878bf73cf223fe5c2636818ba3ab1c585d0403164/numpy-1.26.4-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from -r /build/tmparr9phrh (line 1)):
        Expected sha256 06005a2ef6014e9956c09ba07654f9837d9e26696a0470e42beedadb78c11b07
        Expected     or 09b7847f7e83ca37c6e627682f145856de331049013853f344f37b0c9690e3df
        Expected     or 0aaee12d8883552fadfc41e96b4c82ee7d794949e2a7c3b3a7201e968c7ecab9
        Expected     or 0cbe9848fad08baf71de1a39e12d1b6310f1d5b2d0ea4de051058e6e1076852d
        Expected     or 1b1766d6f397c18153d40015ddfc79ddb715cabadc04d2d228d4e5a8bc4ded1a
        Expected     or 33161613d2269025873025b33e879825ec7b1d831317e68f4f2f0f84ed14c719
        Expected     or 5039f55555e1eab31124a5768898c9e22c25a65c1e0037f4d7c495a45778c9f2
        Expected     or 522e26bbf6377e4d76403826ed689c295b0b238f46c28a7251ab94716da0b280
        Expected     or 56e454c7833e94ec9769fa0f86e6ff8e42ee38ce0ce1fa4cbb747ea7e06d56aa
        Expected     or 58f545efd1108e647604a1b5aa809591ccd2540f468a880bedb97247e72db387
        Expected     or 5e05b1c973a9f858c74367553e236f287e749465f773328c8ef31abe18f691e1
        Expected     or 7903ba8ab592b82014713c491f6c5d3a1cde5b4a3bf116404e08f5b52f6daf43
        Expected     or 8969bfd28e85c81f3f94eb4a66bc2cf1dbdc5c18efc320af34bffc54d6b1e38f
        Expected     or 92c8c1e89a1f5028a4c6d9e3ccbe311b6ba53694811269b992c0b224269e2398
        Expected     or 9c88793f78fca17da0145455f0d7826bcb9f37da4764af27ac945488116efe63
        Expected     or 9fad7dcb1aac3c7f0584a5a8133e3a43eeb2fe127f47e3632d43d677c66c102b
        Expected     or a7ac231a08bb37f852849bbb387a20a57574a97cfc7b6cabb488a4fc8be176de
        Expected     or abdde9f795cf292fb9651ed48185503a2ff29be87770c3b8e2a14b0cd7aa16f8
        Expected     or af1da88f6bc3d2338ebbf0e22fe487821ea4d8e89053e25fa59d1d79786e7481
        Expected     or b2a9ab7c279c91974f756c84c365a669a887efa287365a8e2c418f8b3ba73fb0
        Expected     or bf837dc63ba5c06dc8797c398db1e223a466c7ece27a1f7b5232ba3466aafe3d
        Expected     or ca51fcfcc5f9354c45f400059e88bc09215fb71a48d3768fb80e357f3b457e1e
        Expected     or ce571367b6dfe60af04e04a1834ca2dc5f46004ac1cc756fb95319f64c095a96
        Expected     or d208a0f8729f3fb790ed18a003f3a57895b989b40ea4dce4717e9cf4af62c6bb
        Expected     or dbee87b469018961d1ad79b1a5d50c0ae850000b639bcb1b694e9981083243b6
        Expected     or e9f4c4e51567b616be64e05d517c79a8a22f3606499941d97bb76f2ca59f982d
        Expected     or f063b69b090c9d918f9df0a12116029e274daf0181df392839661c4c7ec9018a
        Expected     or f9a909a8bae284d46bbfdefbdd4a262ba19d3bc9921b1e76126b1d21c3c34135
             Got        7ab55401287bfec946ced39700c053796e7cc0e3acbef09993a9ad2adba6ca6e

For non-cuda aarch64-linux ofborg produces different hash

error: hash mismatch in fixed-output derivation '/nix/store/g0lmxrr2msf250zj1ripy0rv7kywz2dm-tensorflow-2.14.0-deps.tar.gz.drv':
         specified: sha256-Vu4pk5J98zTHBzyLSHdaioqo64cnfCfRQHUX91wEbgM=
            got:    sha256-T3X88roRW9+kUCwaftz1GdjxkxffLSF1VcPMoICNhlg=

will try to build that one too one my machine

@boltzmannrain
Copy link
Contributor

For nix-build --system aarch64-linux -A python312Packages.tensorflow

error: build of '/nix/store/v8xlwfxq5yd0515rv6lhlbanhwgnw704-tensorflow-2.14.0-deps.tar.gz.drv' on 'ssh-ng://khadas' failed: error: hash mismatch in fixed-output derivation '/nix/store/v8xlwfxq5yd0515rv6lhlbanhwgnw704-tensorflow-2.14.0-deps.tar.gz.drv':
                specified: sha256-Vu4pk5J98zTHBzyLSHdaioqo64cnfCfRQHUX91wEbgM=
                   got:    sha256-x62qm084a06fvKxL4W8LL6iMBSWoBphAyRksvSk/bvk=

And for nix-build --system aarch64-linux -A python312Packages.tensorflowWithCuda

INFO: Repository local_config_cuda instantiated at:
  /build/source/WORKSPACE:84:14: in <toplevel>
  /build/source/tensorflow/workspace2.bzl:1020:19: in workspace
  /build/source/tensorflow/workspace2.bzl:105:19: in _tf_toolchains
Repository rule cuda_configure defined at:
  /build/source/third_party/gpus/cuda_configure.bzl:1490:33: in <toplevel>
ERROR: An error occurred during the fetch of repository 'local_config_cuda':
...
ERROR: @local_config_cuda//:enable_cuda :: Error loading option @local_config_cuda//:enable_cuda: Repository command failed
/build/output/external/local_config_cuda/script.py:124: SyntaxWarning: invalid escape sequence '\s'
  match = re.match("\s*#\s*define %s\s+(\d+)" % name, line)
/build/output/external/local_config_cuda/script.py:263: SyntaxWarning: invalid escape sequence '\d'
  pattern = "Cuda compilation tools, release \d+\.\d+, V(\d+\.\d+\.\d+)"
/build/output/external/local_config_cuda/script.py:552: SyntaxWarning: invalid escape sequence '\w'
  match = re.match("^(/[^/ ]*)+/lib/\w+-linux-gnu/?$", os.environ[env_name])

@zeuner
Copy link
Contributor Author

zeuner commented Nov 4, 2024

Thanks for the update !

Would you be able to compute the deps hash for CUDA-enabled aarch64-linux?

nix-build --arg config '{ allowUnfree = true; cudaSupport = true; }' --system aarch64-linux -A python311Packages.tensorflow

Thanks, learned something new. I "enabled" cudaSupport by building tensorflowWithCuda before, which did not trigger this. Should be fixed now.

@zeuner
Copy link
Contributor Author

zeuner commented Nov 4, 2024

On my machine nix-build --system aarch64-linux -A python311Packages.tensorflowWithCuda fails with

ERROR: /build/source/third_party/py/numpy/BUILD:5:6: //third_party/py/numpy:numpy depends on @pypi_numpy//:pkg in repository @pypi_numpy which failed to fetch. no such package '@pypi_numpy//': whl_library pypi_numpy failed: Collecting numpy==1.26.4 (from -r /build/tmparr9phrh (line 1))
  Downloading numpy-1.26.4-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (14.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.2/14.2 MB 5.9 MB/s eta 0:00:00
 (ERROR: THESE PACKAGES DO NOT MATCH THE HASHES FROM THE REQUIREMENTS FILE. If you have updated the package versions, please update the hashes. Otherwise, examine the package contents carefully; someone may have tampered with them.
    numpy==1.26.4 from https://files.pythonhosted.org/packages/79/ae/7e5b85136806f9dadf4878bf73cf223fe5c2636818ba3ab1c585d0403164/numpy-1.26.4-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from -r /build/tmparr9phrh (line 1)):
        Expected sha256 06005a2ef6014e9956c09ba07654f9837d9e26696a0470e42beedadb78c11b07
        Expected     or 09b7847f7e83ca37c6e627682f145856de331049013853f344f37b0c9690e3df
        Expected     or 0aaee12d8883552fadfc41e96b4c82ee7d794949e2a7c3b3a7201e968c7ecab9
        Expected     or 0cbe9848fad08baf71de1a39e12d1b6310f1d5b2d0ea4de051058e6e1076852d
        Expected     or 1b1766d6f397c18153d40015ddfc79ddb715cabadc04d2d228d4e5a8bc4ded1a
        Expected     or 33161613d2269025873025b33e879825ec7b1d831317e68f4f2f0f84ed14c719
        Expected     or 5039f55555e1eab31124a5768898c9e22c25a65c1e0037f4d7c495a45778c9f2
        Expected     or 522e26bbf6377e4d76403826ed689c295b0b238f46c28a7251ab94716da0b280
        Expected     or 56e454c7833e94ec9769fa0f86e6ff8e42ee38ce0ce1fa4cbb747ea7e06d56aa
        Expected     or 58f545efd1108e647604a1b5aa809591ccd2540f468a880bedb97247e72db387
        Expected     or 5e05b1c973a9f858c74367553e236f287e749465f773328c8ef31abe18f691e1
        Expected     or 7903ba8ab592b82014713c491f6c5d3a1cde5b4a3bf116404e08f5b52f6daf43
        Expected     or 8969bfd28e85c81f3f94eb4a66bc2cf1dbdc5c18efc320af34bffc54d6b1e38f
        Expected     or 92c8c1e89a1f5028a4c6d9e3ccbe311b6ba53694811269b992c0b224269e2398
        Expected     or 9c88793f78fca17da0145455f0d7826bcb9f37da4764af27ac945488116efe63
        Expected     or 9fad7dcb1aac3c7f0584a5a8133e3a43eeb2fe127f47e3632d43d677c66c102b
        Expected     or a7ac231a08bb37f852849bbb387a20a57574a97cfc7b6cabb488a4fc8be176de
        Expected     or abdde9f795cf292fb9651ed48185503a2ff29be87770c3b8e2a14b0cd7aa16f8
        Expected     or af1da88f6bc3d2338ebbf0e22fe487821ea4d8e89053e25fa59d1d79786e7481
        Expected     or b2a9ab7c279c91974f756c84c365a669a887efa287365a8e2c418f8b3ba73fb0
        Expected     or bf837dc63ba5c06dc8797c398db1e223a466c7ece27a1f7b5232ba3466aafe3d
        Expected     or ca51fcfcc5f9354c45f400059e88bc09215fb71a48d3768fb80e357f3b457e1e
        Expected     or ce571367b6dfe60af04e04a1834ca2dc5f46004ac1cc756fb95319f64c095a96
        Expected     or d208a0f8729f3fb790ed18a003f3a57895b989b40ea4dce4717e9cf4af62c6bb
        Expected     or dbee87b469018961d1ad79b1a5d50c0ae850000b639bcb1b694e9981083243b6
        Expected     or e9f4c4e51567b616be64e05d517c79a8a22f3606499941d97bb76f2ca59f982d
        Expected     or f063b69b090c9d918f9df0a12116029e274daf0181df392839661c4c7ec9018a
        Expected     or f9a909a8bae284d46bbfdefbdd4a262ba19d3bc9921b1e76126b1d21c3c34135
             Got        7ab55401287bfec946ced39700c053796e7cc0e3acbef09993a9ad2adba6ca6e

Thanks! Added the missing numpy hash, so this should not fail anymore.

For non-cuda aarch64-linux ofborg produces different hash

error: hash mismatch in fixed-output derivation '/nix/store/g0lmxrr2msf250zj1ripy0rv7kywz2dm-tensorflow-2.14.0-deps.tar.gz.drv':
         specified: sha256-Vu4pk5J98zTHBzyLSHdaioqo64cnfCfRQHUX91wEbgM=
            got:    sha256-T3X88roRW9+kUCwaftz1GdjxkxffLSF1VcPMoICNhlg=

will try to build that one too one my machine

I wasn't able to reproduce the deps hash instability on x86_64-linux. Bumped the hash to the one computed by ofborg for now. In case of yet another deps hash mismatch on aarch64-linux, I could use help from someone who can provide a diff between two differing deps builds. E.g. by building with --keep-failed, and diffing build/output/external of two differing builds.

@zeuner
Copy link
Contributor Author

zeuner commented Nov 4, 2024

And for nix-build --system aarch64-linux -A python312Packages.tensorflowWithCuda

INFO: Repository local_config_cuda instantiated at:
  /build/source/WORKSPACE:84:14: in <toplevel>
  /build/source/tensorflow/workspace2.bzl:1020:19: in workspace
  /build/source/tensorflow/workspace2.bzl:105:19: in _tf_toolchains
Repository rule cuda_configure defined at:
  /build/source/third_party/gpus/cuda_configure.bzl:1490:33: in <toplevel>
ERROR: An error occurred during the fetch of repository 'local_config_cuda':
...
ERROR: @local_config_cuda//:enable_cuda :: Error loading option @local_config_cuda//:enable_cuda: Repository command failed
/build/output/external/local_config_cuda/script.py:124: SyntaxWarning: invalid escape sequence '\s'
  match = re.match("\s*#\s*define %s\s+(\d+)" % name, line)
/build/output/external/local_config_cuda/script.py:263: SyntaxWarning: invalid escape sequence '\d'
  pattern = "Cuda compilation tools, release \d+\.\d+, V(\d+\.\d+\.\d+)"
/build/output/external/local_config_cuda/script.py:552: SyntaxWarning: invalid escape sequence '\w'
  match = re.match("^(/[^/ ]*)+/lib/\w+-linux-gnu/?$", os.environ[env_name])

Fixed the error related to Python 3.12 string syntax. I think it builds now. Please note that upstream tensorflow 2.14 doesn't support Python 3.12, so we might drop it if keeping it creates too much hassle.

@GaetanLepage
Copy link
Contributor

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 272838


x86_64-linux

⏩ 28 packages marked as broken and skipped:
  • python311Packages.dm-sonnet
  • python311Packages.dm-sonnet.dist
  • python311Packages.elegy
  • python311Packages.elegy.dist
  • python311Packages.mhcflurry
  • python311Packages.mhcflurry.dist
  • python311Packages.objax
  • python311Packages.objax.dist
  • python311Packages.tensorflow-datasets
  • python311Packages.tensorflow-datasets.dist
  • python311Packages.tf2onnx
  • python311Packages.tf2onnx.dist
  • python311Packages.treex
  • python311Packages.treex.dist
  • python312Packages.elegy
  • python312Packages.elegy.dist
  • python312Packages.mhcflurry
  • python312Packages.mhcflurry.dist
  • python312Packages.objax
  • python312Packages.objax.dist
  • python312Packages.pettingzoo
  • python312Packages.pettingzoo.dist
  • python312Packages.shimmy
  • python312Packages.shimmy.dist
  • python312Packages.tf2onnx
  • python312Packages.tf2onnx.dist
  • python312Packages.treex
  • python312Packages.treex.dist
❌ 86 packages failed to build:
  • minari (python312Packages.minari)
  • minari.dist (python312Packages.minari.dist)
  • python311Packages.ale-py
  • python311Packages.ale-py.dist
  • python311Packages.bambi
  • python311Packages.bambi.dist
  • python311Packages.dalle-mini
  • python311Packages.dalle-mini.dist
  • python311Packages.deepface
  • python311Packages.deepface.dist
  • python311Packages.distrax
  • python311Packages.distrax.dist
  • python311Packages.dm-haiku
  • python311Packages.dm-haiku.dist
  • python311Packages.evosax
  • python311Packages.evosax.dist
  • python311Packages.flax
  • python311Packages.flax.dist
  • python311Packages.flowmc
  • python311Packages.flowmc.dist
  • python311Packages.gymnasium
  • python311Packages.gymnasium.dist
  • python311Packages.minari
  • python311Packages.minari.dist
  • python311Packages.mtcnn
  • python311Packages.mtcnn.dist
  • python311Packages.oryx
  • python311Packages.oryx.dist
  • python311Packages.pettingzoo
  • python311Packages.pettingzoo.dist
  • python311Packages.pymc
  • python311Packages.pymc.dist
  • python311Packages.pytensor
  • python311Packages.pytensor.dist
  • python311Packages.retinaface
  • python311Packages.retinaface.dist
  • python311Packages.rlax
  • python311Packages.rlax.dist
  • python311Packages.shimmy
  • python311Packages.shimmy.dist
  • python311Packages.skrl
  • python311Packages.skrl.dist
  • python311Packages.torchrl
  • python311Packages.torchrl.dist
  • python311Packages.vqgan-jax
  • python311Packages.vqgan-jax.dist
  • python312Packages.ale-py
  • python312Packages.ale-py.dist
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.cleanlab
  • python312Packages.cleanlab.dist
  • python312Packages.dalle-mini
  • python312Packages.dalle-mini.dist
  • python312Packages.deepface
  • python312Packages.deepface.dist
  • python312Packages.distrax
  • python312Packages.distrax.dist
  • python312Packages.dm-haiku
  • python312Packages.dm-haiku.dist
  • python312Packages.evosax
  • python312Packages.evosax.dist
  • python312Packages.flax
  • python312Packages.flax.dist
  • python312Packages.flowmc
  • python312Packages.flowmc.dist
  • python312Packages.gymnasium
  • python312Packages.gymnasium.dist
  • python312Packages.mtcnn
  • python312Packages.mtcnn.dist
  • python312Packages.oryx
  • python312Packages.oryx.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
  • python312Packages.pytensor
  • python312Packages.pytensor.dist
  • python312Packages.retinaface
  • python312Packages.retinaface.dist
  • python312Packages.rlax
  • python312Packages.rlax.dist
  • python312Packages.skrl
  • python312Packages.skrl.dist
  • python312Packages.torchrl
  • python312Packages.torchrl.dist
  • python312Packages.vqgan-jax
  • python312Packages.vqgan-jax.dist
✅ 48 packages built:
  • gpt2tc
  • libtensorflow (libtensorflow.python)
  • python311Packages.baselines
  • python311Packages.baselines.dist
  • python311Packages.cleanlab
  • python311Packages.cleanlab.dist
  • python311Packages.edward
  • python311Packages.edward.dist
  • python311Packages.gpt-2-simple
  • python311Packages.gpt-2-simple.dist
  • python311Packages.imgcat
  • python311Packages.imgcat.dist
  • python311Packages.keras
  • python311Packages.keras.dist
  • python311Packages.tensorflow (python311Packages.tensorflow-build ,python311Packages.tensorflowWithoutCuda)
  • python311Packages.tensorflow.dist (python311Packages.tensorflow-build.dist ,python311Packages.tensorflowWithoutCuda.dist)
  • python311Packages.tensorflow-probability
  • python311Packages.tensorflow-probability.dist
  • python311Packages.tensorflowWithCuda
  • python311Packages.tensorflowWithCuda.dist
  • python311Packages.tf-keras
  • python311Packages.tf-keras.dist
  • python311Packages.tflearn
  • python311Packages.tflearn.dist
  • python312Packages.baselines
  • python312Packages.baselines.dist
  • python312Packages.edward
  • python312Packages.edward.dist
  • python312Packages.gpt-2-simple
  • python312Packages.gpt-2-simple.dist
  • python312Packages.imgcat
  • python312Packages.imgcat.dist
  • python312Packages.keras
  • python312Packages.keras.dist
  • python312Packages.tensorflow (python312Packages.tensorflow-build ,python312Packages.tensorflowWithoutCuda)
  • python312Packages.tensorflow.dist (python312Packages.tensorflow-build.dist ,python312Packages.tensorflowWithoutCuda.dist)
  • python312Packages.tensorflow-probability
  • python312Packages.tensorflow-probability.dist
  • python312Packages.tensorflowWithCuda
  • python312Packages.tensorflowWithCuda.dist
  • python312Packages.tf-keras
  • python312Packages.tf-keras.dist
  • python312Packages.tflearn
  • python312Packages.tflearn.dist
  • witnessme
  • witnessme.dist
  • wyoming-openwakeword
  • wyoming-openwakeword.dist

aarch64-linux

⏩ 24 packages marked as broken and skipped:
  • python311Packages.elegy
  • python311Packages.elegy.dist
  • python311Packages.mhcflurry
  • python311Packages.mhcflurry.dist
  • python311Packages.objax
  • python311Packages.objax.dist
  • python311Packages.tf2onnx
  • python311Packages.tf2onnx.dist
  • python311Packages.treex
  • python311Packages.treex.dist
  • python312Packages.elegy
  • python312Packages.elegy.dist
  • python312Packages.mhcflurry
  • python312Packages.mhcflurry.dist
  • python312Packages.objax
  • python312Packages.objax.dist
  • python312Packages.pettingzoo
  • python312Packages.pettingzoo.dist
  • python312Packages.shimmy
  • python312Packages.shimmy.dist
  • python312Packages.tf2onnx
  • python312Packages.tf2onnx.dist
  • python312Packages.treex
  • python312Packages.treex.dist
❌ 133 packages failed to build:
  • libtensorflow (libtensorflow.python)
  • minari (python312Packages.minari)
  • minari.dist (python312Packages.minari.dist)
  • python311Packages.ale-py
  • python311Packages.ale-py.dist
  • python311Packages.bambi
  • python311Packages.bambi.dist
  • python311Packages.baselines
  • python311Packages.baselines.dist
  • python311Packages.cleanlab
  • python311Packages.cleanlab.dist
  • python311Packages.dalle-mini
  • python311Packages.dalle-mini.dist
  • python311Packages.deepface
  • python311Packages.deepface.dist
  • python311Packages.distrax
  • python311Packages.distrax.dist
  • python311Packages.dm-haiku
  • python311Packages.dm-haiku.dist
  • python311Packages.edward
  • python311Packages.edward.dist
  • python311Packages.evosax
  • python311Packages.evosax.dist
  • python311Packages.flax
  • python311Packages.flax.dist
  • python311Packages.flowmc
  • python311Packages.flowmc.dist
  • python311Packages.gpt-2-simple
  • python311Packages.gpt-2-simple.dist
  • python311Packages.gymnasium
  • python311Packages.gymnasium.dist
  • python311Packages.imgcat
  • python311Packages.imgcat.dist
  • python311Packages.keras
  • python311Packages.keras.dist
  • python311Packages.minari
  • python311Packages.minari.dist
  • python311Packages.mtcnn
  • python311Packages.mtcnn.dist
  • python311Packages.oryx
  • python311Packages.oryx.dist
  • python311Packages.pettingzoo
  • python311Packages.pettingzoo.dist
  • python311Packages.pymc
  • python311Packages.pymc.dist
  • python311Packages.pytensor
  • python311Packages.pytensor.dist
  • python311Packages.retinaface
  • python311Packages.retinaface.dist
  • python311Packages.rlax
  • python311Packages.rlax.dist
  • python311Packages.shimmy
  • python311Packages.shimmy.dist
  • python311Packages.skrl
  • python311Packages.skrl.dist
  • python311Packages.tensorflow (python311Packages.tensorflow-build ,python311Packages.tensorflowWithoutCuda)
  • python311Packages.tensorflow.dist (python311Packages.tensorflow-build.dist ,python311Packages.tensorflowWithoutCuda.dist)
  • python311Packages.tensorflow-probability
  • python311Packages.tensorflow-probability.dist
  • python311Packages.tensorflowWithCuda
  • python311Packages.tensorflowWithCuda.dist
  • python311Packages.tf-keras
  • python311Packages.tf-keras.dist
  • python311Packages.tflearn
  • python311Packages.tflearn.dist
  • python311Packages.torchrl
  • python311Packages.torchrl.dist
  • python311Packages.vqgan-jax
  • python311Packages.vqgan-jax.dist
  • python312Packages.ale-py
  • python312Packages.ale-py.dist
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.baselines
  • python312Packages.baselines.dist
  • python312Packages.cleanlab
  • python312Packages.cleanlab.dist
  • python312Packages.dalle-mini
  • python312Packages.dalle-mini.dist
  • python312Packages.deepface
  • python312Packages.deepface.dist
  • python312Packages.distrax
  • python312Packages.distrax.dist
  • python312Packages.dm-haiku
  • python312Packages.dm-haiku.dist
  • python312Packages.edward
  • python312Packages.edward.dist
  • python312Packages.evosax
  • python312Packages.evosax.dist
  • python312Packages.flax
  • python312Packages.flax.dist
  • python312Packages.flowmc
  • python312Packages.flowmc.dist
  • python312Packages.gpt-2-simple
  • python312Packages.gpt-2-simple.dist
  • python312Packages.gymnasium
  • python312Packages.gymnasium.dist
  • python312Packages.imgcat
  • python312Packages.imgcat.dist
  • python312Packages.keras
  • python312Packages.keras.dist
  • python312Packages.mtcnn
  • python312Packages.mtcnn.dist
  • python312Packages.oryx
  • python312Packages.oryx.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
  • python312Packages.pytensor
  • python312Packages.pytensor.dist
  • python312Packages.retinaface
  • python312Packages.retinaface.dist
  • python312Packages.rlax
  • python312Packages.rlax.dist
  • python312Packages.skrl
  • python312Packages.skrl.dist
  • python312Packages.tensorflow (python312Packages.tensorflow-build ,python312Packages.tensorflowWithoutCuda)
  • python312Packages.tensorflow.dist (python312Packages.tensorflow-build.dist ,python312Packages.tensorflowWithoutCuda.dist)
  • python312Packages.tensorflow-probability
  • python312Packages.tensorflow-probability.dist
  • python312Packages.tensorflowWithCuda
  • python312Packages.tensorflowWithCuda.dist
  • python312Packages.tf-keras
  • python312Packages.tf-keras.dist
  • python312Packages.tflearn
  • python312Packages.tflearn.dist
  • python312Packages.torchrl
  • python312Packages.torchrl.dist
  • python312Packages.vqgan-jax
  • python312Packages.vqgan-jax.dist
  • witnessme
  • witnessme.dist
  • wyoming-openwakeword
  • wyoming-openwakeword.dist

x86_64-darwin

⏩ 66 packages marked as broken and skipped:
  • libtensorflow
  • libtensorflow.python
  • python311Packages.bambi
  • python311Packages.bambi.dist
  • python311Packages.cleanlab
  • python311Packages.cleanlab.dist
  • python311Packages.mhcflurry
  • python311Packages.mhcflurry.dist
  • python311Packages.objax
  • python311Packages.objax.dist
  • python311Packages.oryx
  • python311Packages.oryx.dist
  • python311Packages.pymc
  • python311Packages.pymc.dist
  • python311Packages.pytensor
  • python311Packages.pytensor.dist
  • python311Packages.tf2onnx
  • python311Packages.tf2onnx.dist
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.baselines
  • python312Packages.baselines.dist
  • python312Packages.cleanlab
  • python312Packages.cleanlab.dist
  • python312Packages.deepface
  • python312Packages.deepface.dist
  • python312Packages.edward
  • python312Packages.edward.dist
  • python312Packages.gpt-2-simple
  • python312Packages.gpt-2-simple.dist
  • python312Packages.imgcat
  • python312Packages.imgcat.dist
  • python312Packages.keras
  • python312Packages.keras.dist
  • python312Packages.mhcflurry
  • python312Packages.mhcflurry.dist
  • python312Packages.mtcnn
  • python312Packages.mtcnn.dist
  • python312Packages.objax
  • python312Packages.objax.dist
  • python312Packages.oryx
  • python312Packages.oryx.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
  • python312Packages.pytensor
  • python312Packages.pytensor.dist
  • python312Packages.retinaface
  • python312Packages.retinaface.dist
  • python312Packages.tensorflow
  • python312Packages.tensorflow-build
  • python312Packages.tensorflow-build.dist
  • python312Packages.tensorflow-probability
  • python312Packages.tensorflow-probability.dist
  • python312Packages.tensorflow.dist
  • python312Packages.tensorflowWithoutCuda
  • python312Packages.tensorflowWithoutCuda.dist
  • python312Packages.tf-keras
  • python312Packages.tf-keras.dist
  • python312Packages.tf2onnx
  • python312Packages.tf2onnx.dist
  • python312Packages.tflearn
  • python312Packages.tflearn.dist
  • witnessme
  • witnessme.dist
  • wyoming-openwakeword
  • wyoming-openwakeword.dist
❌ 24 packages failed to build:
  • python311Packages.baselines
  • python311Packages.baselines.dist
  • python311Packages.deepface
  • python311Packages.deepface.dist
  • python311Packages.edward
  • python311Packages.edward.dist
  • python311Packages.gpt-2-simple
  • python311Packages.gpt-2-simple.dist
  • python311Packages.imgcat
  • python311Packages.imgcat.dist
  • python311Packages.keras
  • python311Packages.keras.dist
  • python311Packages.mtcnn
  • python311Packages.mtcnn.dist
  • python311Packages.retinaface
  • python311Packages.retinaface.dist
  • python311Packages.tensorflow (python311Packages.tensorflow-build ,python311Packages.tensorflowWithoutCuda)
  • python311Packages.tensorflow.dist (python311Packages.tensorflow-build.dist ,python311Packages.tensorflowWithoutCuda.dist)
  • python311Packages.tensorflow-probability
  • python311Packages.tensorflow-probability.dist
  • python311Packages.tf-keras
  • python311Packages.tf-keras.dist
  • python311Packages.tflearn
  • python311Packages.tflearn.dist

aarch64-darwin

⏩ 84 packages marked as broken and skipped:
  • libtensorflow
  • libtensorflow.python
  • python311Packages.cleanlab
  • python311Packages.cleanlab.dist
  • python311Packages.dalle-mini
  • python311Packages.dalle-mini.dist
  • python311Packages.elegy
  • python311Packages.elegy.dist
  • python311Packages.mhcflurry
  • python311Packages.mhcflurry.dist
  • python311Packages.objax
  • python311Packages.objax.dist
  • python311Packages.tf2onnx
  • python311Packages.tf2onnx.dist
  • python311Packages.treex
  • python311Packages.treex.dist
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.baselines
  • python312Packages.baselines.dist
  • python312Packages.cleanlab
  • python312Packages.cleanlab.dist
  • python312Packages.dalle-mini
  • python312Packages.dalle-mini.dist
  • python312Packages.deepface
  • python312Packages.deepface.dist
  • python312Packages.distrax
  • python312Packages.distrax.dist
  • python312Packages.dm-haiku
  • python312Packages.dm-haiku.dist
  • python312Packages.edward
  • python312Packages.edward.dist
  • python312Packages.elegy
  • python312Packages.elegy.dist
  • python312Packages.evosax
  • python312Packages.evosax.dist
  • python312Packages.flax
  • python312Packages.flax.dist
  • python312Packages.flowmc
  • python312Packages.flowmc.dist
  • python312Packages.gpt-2-simple
  • python312Packages.gpt-2-simple.dist
  • python312Packages.imgcat
  • python312Packages.imgcat.dist
  • python312Packages.keras
  • python312Packages.keras.dist
  • python312Packages.mhcflurry
  • python312Packages.mhcflurry.dist
  • python312Packages.mtcnn
  • python312Packages.mtcnn.dist
  • python312Packages.objax
  • python312Packages.objax.dist
  • python312Packages.oryx
  • python312Packages.oryx.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
  • python312Packages.pytensor
  • python312Packages.pytensor.dist
  • python312Packages.retinaface
  • python312Packages.retinaface.dist
  • python312Packages.rlax
  • python312Packages.rlax.dist
  • python312Packages.tensorflow
  • python312Packages.tensorflow-build
  • python312Packages.tensorflow-build.dist
  • python312Packages.tensorflow-probability
  • python312Packages.tensorflow-probability.dist
  • python312Packages.tensorflow.dist
  • python312Packages.tensorflowWithoutCuda
  • python312Packages.tensorflowWithoutCuda.dist
  • python312Packages.tf-keras
  • python312Packages.tf-keras.dist
  • python312Packages.tf2onnx
  • python312Packages.tf2onnx.dist
  • python312Packages.tflearn
  • python312Packages.tflearn.dist
  • python312Packages.treex
  • python312Packages.treex.dist
  • python312Packages.vqgan-jax
  • python312Packages.vqgan-jax.dist
  • witnessme
  • witnessme.dist
  • wyoming-openwakeword
  • wyoming-openwakeword.dist
❌ 46 packages failed to build:
  • python311Packages.bambi
  • python311Packages.bambi.dist
  • python311Packages.baselines
  • python311Packages.baselines.dist
  • python311Packages.deepface
  • python311Packages.deepface.dist
  • python311Packages.distrax
  • python311Packages.distrax.dist
  • python311Packages.dm-haiku
  • python311Packages.dm-haiku.dist
  • python311Packages.edward
  • python311Packages.edward.dist
  • python311Packages.evosax
  • python311Packages.evosax.dist
  • python311Packages.flax
  • python311Packages.flax.dist
  • python311Packages.flowmc
  • python311Packages.flowmc.dist
  • python311Packages.gpt-2-simple
  • python311Packages.gpt-2-simple.dist
  • python311Packages.imgcat
  • python311Packages.imgcat.dist
  • python311Packages.keras
  • python311Packages.keras.dist
  • python311Packages.mtcnn
  • python311Packages.mtcnn.dist
  • python311Packages.oryx
  • python311Packages.oryx.dist
  • python311Packages.pymc
  • python311Packages.pymc.dist
  • python311Packages.pytensor
  • python311Packages.pytensor.dist
  • python311Packages.retinaface
  • python311Packages.retinaface.dist
  • python311Packages.rlax
  • python311Packages.rlax.dist
  • python311Packages.tensorflow (python311Packages.tensorflow-build ,python311Packages.tensorflowWithoutCuda)
  • python311Packages.tensorflow.dist (python311Packages.tensorflow-build.dist ,python311Packages.tensorflowWithoutCuda.dist)
  • python311Packages.tensorflow-probability
  • python311Packages.tensorflow-probability.dist
  • python311Packages.tf-keras
  • python311Packages.tf-keras.dist
  • python311Packages.tflearn
  • python311Packages.tflearn.dist
  • python311Packages.vqgan-jax
  • python311Packages.vqgan-jax.dist

@GaetanLepage
Copy link
Contributor

Thanks, learned something new. I "enabled" cudaSupport by building tensorflowWithCuda before, which did not trigger this. Should be fixed now.

Yes, they are slightly different.
tensorflowWithCuda only overrides the cudaSupport argument for the tensorflow package, while enabling cudaSupport globally will affect the entire nixpkgs package set.

@GaetanLepage
Copy link
Contributor

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 272838


x86_64-linux

⏩ 28 packages marked as broken and skipped:
  • python311Packages.dm-sonnet
  • python311Packages.dm-sonnet.dist
  • python311Packages.elegy
  • python311Packages.elegy.dist
  • python311Packages.mhcflurry
  • python311Packages.mhcflurry.dist
  • python311Packages.objax
  • python311Packages.objax.dist
  • python311Packages.tensorflow-datasets
  • python311Packages.tensorflow-datasets.dist
  • python311Packages.tf2onnx
  • python311Packages.tf2onnx.dist
  • python311Packages.treex
  • python311Packages.treex.dist
  • python312Packages.elegy
  • python312Packages.elegy.dist
  • python312Packages.mhcflurry
  • python312Packages.mhcflurry.dist
  • python312Packages.objax
  • python312Packages.objax.dist
  • python312Packages.pettingzoo
  • python312Packages.pettingzoo.dist
  • python312Packages.shimmy
  • python312Packages.shimmy.dist
  • python312Packages.tf2onnx
  • python312Packages.tf2onnx.dist
  • python312Packages.treex
  • python312Packages.treex.dist
❌ 86 packages failed to build:
  • minari (python312Packages.minari)
  • minari.dist (python312Packages.minari.dist)
  • python311Packages.ale-py
  • python311Packages.ale-py.dist
  • python311Packages.bambi
  • python311Packages.bambi.dist
  • python311Packages.dalle-mini
  • python311Packages.dalle-mini.dist
  • python311Packages.deepface
  • python311Packages.deepface.dist
  • python311Packages.distrax
  • python311Packages.distrax.dist
  • python311Packages.dm-haiku
  • python311Packages.dm-haiku.dist
  • python311Packages.evosax
  • python311Packages.evosax.dist
  • python311Packages.flax
  • python311Packages.flax.dist
  • python311Packages.flowmc
  • python311Packages.flowmc.dist
  • python311Packages.gymnasium
  • python311Packages.gymnasium.dist
  • python311Packages.minari
  • python311Packages.minari.dist
  • python311Packages.mtcnn
  • python311Packages.mtcnn.dist
  • python311Packages.oryx
  • python311Packages.oryx.dist
  • python311Packages.pettingzoo
  • python311Packages.pettingzoo.dist
  • python311Packages.pymc
  • python311Packages.pymc.dist
  • python311Packages.pytensor
  • python311Packages.pytensor.dist
  • python311Packages.retinaface
  • python311Packages.retinaface.dist
  • python311Packages.rlax
  • python311Packages.rlax.dist
  • python311Packages.shimmy
  • python311Packages.shimmy.dist
  • python311Packages.skrl
  • python311Packages.skrl.dist
  • python311Packages.torchrl
  • python311Packages.torchrl.dist
  • python311Packages.vqgan-jax
  • python311Packages.vqgan-jax.dist
  • python312Packages.ale-py
  • python312Packages.ale-py.dist
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.cleanlab
  • python312Packages.cleanlab.dist
  • python312Packages.dalle-mini
  • python312Packages.dalle-mini.dist
  • python312Packages.deepface
  • python312Packages.deepface.dist
  • python312Packages.distrax
  • python312Packages.distrax.dist
  • python312Packages.dm-haiku
  • python312Packages.dm-haiku.dist
  • python312Packages.evosax
  • python312Packages.evosax.dist
  • python312Packages.flax
  • python312Packages.flax.dist
  • python312Packages.flowmc
  • python312Packages.flowmc.dist
  • python312Packages.gymnasium
  • python312Packages.gymnasium.dist
  • python312Packages.mtcnn
  • python312Packages.mtcnn.dist
  • python312Packages.oryx
  • python312Packages.oryx.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
  • python312Packages.pytensor
  • python312Packages.pytensor.dist
  • python312Packages.retinaface
  • python312Packages.retinaface.dist
  • python312Packages.rlax
  • python312Packages.rlax.dist
  • python312Packages.skrl
  • python312Packages.skrl.dist
  • python312Packages.torchrl
  • python312Packages.torchrl.dist
  • python312Packages.vqgan-jax
  • python312Packages.vqgan-jax.dist
✅ 49 packages built:
  • gpt2tc
  • libtensorflow (libtensorflow.python)
  • python311Packages.baselines
  • python311Packages.baselines.dist
  • python311Packages.cleanlab
  • python311Packages.cleanlab.dist
  • python311Packages.edward
  • python311Packages.edward.dist
  • python311Packages.gpt-2-simple
  • python311Packages.gpt-2-simple.dist
  • python311Packages.imgcat
  • python311Packages.imgcat.dist
  • python311Packages.keras
  • python311Packages.keras.dist
  • python311Packages.tensorflow (python311Packages.tensorflow-build ,python311Packages.tensorflowWithoutCuda)
  • python311Packages.tensorflow.dist (python311Packages.tensorflow-build.dist ,python311Packages.tensorflowWithoutCuda.dist)
  • python311Packages.tensorflow-probability
  • python311Packages.tensorflow-probability.dist
  • python311Packages.tensorflowWithCuda
  • python311Packages.tensorflowWithCuda.dist
  • python311Packages.tf-keras
  • python311Packages.tf-keras.dist
  • python311Packages.tflearn
  • python311Packages.tflearn.dist
  • python312Packages.baselines
  • python312Packages.baselines.dist
  • python312Packages.edward
  • python312Packages.edward.dist
  • python312Packages.gpt-2-simple
  • python312Packages.gpt-2-simple.dist
  • python312Packages.imgcat
  • python312Packages.imgcat.dist
  • python312Packages.keras
  • python312Packages.keras.dist
  • python312Packages.tensorflow (python312Packages.tensorflow-build ,python312Packages.tensorflowWithoutCuda)
  • python312Packages.tensorflow.dist (python312Packages.tensorflow-build.dist ,python312Packages.tensorflowWithoutCuda.dist)
  • python312Packages.tensorflow-probability
  • python312Packages.tensorflow-probability.dist
  • python312Packages.tensorflowWithCuda
  • python312Packages.tensorflowWithCuda.dist
  • python312Packages.tf-keras
  • python312Packages.tf-keras.dist
  • python312Packages.tflearn
  • python312Packages.tflearn.dist
  • tests.pkg-config.defaultPkgConfigPackages.tensorflow
  • witnessme
  • witnessme.dist
  • wyoming-openwakeword
  • wyoming-openwakeword.dist

aarch64-linux

⏩ 28 packages marked as broken and skipped:
  • python311Packages.dm-sonnet
  • python311Packages.dm-sonnet.dist
  • python311Packages.elegy
  • python311Packages.elegy.dist
  • python311Packages.mhcflurry
  • python311Packages.mhcflurry.dist
  • python311Packages.objax
  • python311Packages.objax.dist
  • python311Packages.tensorflow-datasets
  • python311Packages.tensorflow-datasets.dist
  • python311Packages.tf2onnx
  • python311Packages.tf2onnx.dist
  • python311Packages.treex
  • python311Packages.treex.dist
  • python312Packages.elegy
  • python312Packages.elegy.dist
  • python312Packages.mhcflurry
  • python312Packages.mhcflurry.dist
  • python312Packages.objax
  • python312Packages.objax.dist
  • python312Packages.pettingzoo
  • python312Packages.pettingzoo.dist
  • python312Packages.shimmy
  • python312Packages.shimmy.dist
  • python312Packages.tf2onnx
  • python312Packages.tf2onnx.dist
  • python312Packages.treex
  • python312Packages.treex.dist
❌ 90 packages failed to build:
  • minari (python312Packages.minari)
  • minari.dist (python312Packages.minari.dist)
  • python311Packages.ale-py
  • python311Packages.ale-py.dist
  • python311Packages.bambi
  • python311Packages.bambi.dist
  • python311Packages.dalle-mini
  • python311Packages.dalle-mini.dist
  • python311Packages.deepface
  • python311Packages.deepface.dist
  • python311Packages.distrax
  • python311Packages.distrax.dist
  • python311Packages.dm-haiku
  • python311Packages.dm-haiku.dist
  • python311Packages.evosax
  • python311Packages.evosax.dist
  • python311Packages.flax
  • python311Packages.flax.dist
  • python311Packages.flowmc
  • python311Packages.flowmc.dist
  • python311Packages.gymnasium
  • python311Packages.gymnasium.dist
  • python311Packages.minari
  • python311Packages.minari.dist
  • python311Packages.mtcnn
  • python311Packages.mtcnn.dist
  • python311Packages.oryx
  • python311Packages.oryx.dist
  • python311Packages.pettingzoo
  • python311Packages.pettingzoo.dist
  • python311Packages.pymc
  • python311Packages.pymc.dist
  • python311Packages.pytensor
  • python311Packages.pytensor.dist
  • python311Packages.retinaface
  • python311Packages.retinaface.dist
  • python311Packages.rlax
  • python311Packages.rlax.dist
  • python311Packages.shimmy
  • python311Packages.shimmy.dist
  • python311Packages.skrl
  • python311Packages.skrl.dist
  • python311Packages.tensorflowWithCuda
  • python311Packages.tensorflowWithCuda.dist
  • python311Packages.torchrl
  • python311Packages.torchrl.dist
  • python311Packages.vqgan-jax
  • python311Packages.vqgan-jax.dist
  • python312Packages.ale-py
  • python312Packages.ale-py.dist
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.cleanlab
  • python312Packages.cleanlab.dist
  • python312Packages.dalle-mini
  • python312Packages.dalle-mini.dist
  • python312Packages.deepface
  • python312Packages.deepface.dist
  • python312Packages.distrax
  • python312Packages.distrax.dist
  • python312Packages.dm-haiku
  • python312Packages.dm-haiku.dist
  • python312Packages.evosax
  • python312Packages.evosax.dist
  • python312Packages.flax
  • python312Packages.flax.dist
  • python312Packages.flowmc
  • python312Packages.flowmc.dist
  • python312Packages.gymnasium
  • python312Packages.gymnasium.dist
  • python312Packages.mtcnn
  • python312Packages.mtcnn.dist
  • python312Packages.oryx
  • python312Packages.oryx.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
  • python312Packages.pytensor
  • python312Packages.pytensor.dist
  • python312Packages.retinaface
  • python312Packages.retinaface.dist
  • python312Packages.rlax
  • python312Packages.rlax.dist
  • python312Packages.skrl
  • python312Packages.skrl.dist
  • python312Packages.tensorflowWithCuda
  • python312Packages.tensorflowWithCuda.dist
  • python312Packages.torchrl
  • python312Packages.torchrl.dist
  • python312Packages.vqgan-jax
  • python312Packages.vqgan-jax.dist
✅ 44 packages built:
  • libtensorflow (libtensorflow.python)
  • python311Packages.baselines
  • python311Packages.baselines.dist
  • python311Packages.cleanlab
  • python311Packages.cleanlab.dist
  • python311Packages.edward
  • python311Packages.edward.dist
  • python311Packages.gpt-2-simple
  • python311Packages.gpt-2-simple.dist
  • python311Packages.imgcat
  • python311Packages.imgcat.dist
  • python311Packages.keras
  • python311Packages.keras.dist
  • python311Packages.tensorflow (python311Packages.tensorflow-build ,python311Packages.tensorflowWithoutCuda)
  • python311Packages.tensorflow.dist (python311Packages.tensorflow-build.dist ,python311Packages.tensorflowWithoutCuda.dist)
  • python311Packages.tensorflow-probability
  • python311Packages.tensorflow-probability.dist
  • python311Packages.tf-keras
  • python311Packages.tf-keras.dist
  • python311Packages.tflearn
  • python311Packages.tflearn.dist
  • python312Packages.baselines
  • python312Packages.baselines.dist
  • python312Packages.edward
  • python312Packages.edward.dist
  • python312Packages.gpt-2-simple
  • python312Packages.gpt-2-simple.dist
  • python312Packages.imgcat
  • python312Packages.imgcat.dist
  • python312Packages.keras
  • python312Packages.keras.dist
  • python312Packages.tensorflow (python312Packages.tensorflow-build ,python312Packages.tensorflowWithoutCuda)
  • python312Packages.tensorflow.dist (python312Packages.tensorflow-build.dist ,python312Packages.tensorflowWithoutCuda.dist)
  • python312Packages.tensorflow-probability
  • python312Packages.tensorflow-probability.dist
  • python312Packages.tf-keras
  • python312Packages.tf-keras.dist
  • python312Packages.tflearn
  • python312Packages.tflearn.dist
  • tests.pkg-config.defaultPkgConfigPackages.tensorflow
  • witnessme
  • witnessme.dist
  • wyoming-openwakeword
  • wyoming-openwakeword.dist

x86_64-darwin

⏩ 71 packages marked as broken and skipped:
  • libtensorflow
  • libtensorflow.python
  • python311Packages.bambi
  • python311Packages.bambi.dist
  • python311Packages.cleanlab
  • python311Packages.cleanlab.dist
  • python311Packages.dm-sonnet
  • python311Packages.dm-sonnet.dist
  • python311Packages.mhcflurry
  • python311Packages.mhcflurry.dist
  • python311Packages.objax
  • python311Packages.objax.dist
  • python311Packages.oryx
  • python311Packages.oryx.dist
  • python311Packages.pymc
  • python311Packages.pymc.dist
  • python311Packages.pytensor
  • python311Packages.pytensor.dist
  • python311Packages.tensorflow-datasets
  • python311Packages.tensorflow-datasets.dist
  • python311Packages.tf2onnx
  • python311Packages.tf2onnx.dist
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.baselines
  • python312Packages.baselines.dist
  • python312Packages.cleanlab
  • python312Packages.cleanlab.dist
  • python312Packages.deepface
  • python312Packages.deepface.dist
  • python312Packages.edward
  • python312Packages.edward.dist
  • python312Packages.gpt-2-simple
  • python312Packages.gpt-2-simple.dist
  • python312Packages.imgcat
  • python312Packages.imgcat.dist
  • python312Packages.keras
  • python312Packages.keras.dist
  • python312Packages.mhcflurry
  • python312Packages.mhcflurry.dist
  • python312Packages.mtcnn
  • python312Packages.mtcnn.dist
  • python312Packages.objax
  • python312Packages.objax.dist
  • python312Packages.oryx
  • python312Packages.oryx.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
  • python312Packages.pytensor
  • python312Packages.pytensor.dist
  • python312Packages.retinaface
  • python312Packages.retinaface.dist
  • python312Packages.tensorflow
  • python312Packages.tensorflow-build
  • python312Packages.tensorflow-build.dist
  • python312Packages.tensorflow-probability
  • python312Packages.tensorflow-probability.dist
  • python312Packages.tensorflow.dist
  • python312Packages.tensorflowWithoutCuda
  • python312Packages.tensorflowWithoutCuda.dist
  • python312Packages.tf-keras
  • python312Packages.tf-keras.dist
  • python312Packages.tf2onnx
  • python312Packages.tf2onnx.dist
  • python312Packages.tflearn
  • python312Packages.tflearn.dist
  • tests.pkg-config.defaultPkgConfigPackages.tensorflow
  • witnessme
  • witnessme.dist
  • wyoming-openwakeword
  • wyoming-openwakeword.dist
❌ 24 packages failed to build:
  • python311Packages.baselines
  • python311Packages.baselines.dist
  • python311Packages.deepface
  • python311Packages.deepface.dist
  • python311Packages.edward
  • python311Packages.edward.dist
  • python311Packages.gpt-2-simple
  • python311Packages.gpt-2-simple.dist
  • python311Packages.imgcat
  • python311Packages.imgcat.dist
  • python311Packages.keras
  • python311Packages.keras.dist
  • python311Packages.mtcnn
  • python311Packages.mtcnn.dist
  • python311Packages.retinaface
  • python311Packages.retinaface.dist
  • python311Packages.tensorflow (python311Packages.tensorflow-build ,python311Packages.tensorflowWithoutCuda)
  • python311Packages.tensorflow.dist (python311Packages.tensorflow-build.dist ,python311Packages.tensorflowWithoutCuda.dist)
  • python311Packages.tensorflow-probability
  • python311Packages.tensorflow-probability.dist
  • python311Packages.tf-keras
  • python311Packages.tf-keras.dist
  • python311Packages.tflearn
  • python311Packages.tflearn.dist

aarch64-darwin

⏩ 89 packages marked as broken and skipped:
  • libtensorflow
  • libtensorflow.python
  • python311Packages.cleanlab
  • python311Packages.cleanlab.dist
  • python311Packages.dalle-mini
  • python311Packages.dalle-mini.dist
  • python311Packages.dm-sonnet
  • python311Packages.dm-sonnet.dist
  • python311Packages.elegy
  • python311Packages.elegy.dist
  • python311Packages.mhcflurry
  • python311Packages.mhcflurry.dist
  • python311Packages.objax
  • python311Packages.objax.dist
  • python311Packages.tensorflow-datasets
  • python311Packages.tensorflow-datasets.dist
  • python311Packages.tf2onnx
  • python311Packages.tf2onnx.dist
  • python311Packages.treex
  • python311Packages.treex.dist
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.baselines
  • python312Packages.baselines.dist
  • python312Packages.cleanlab
  • python312Packages.cleanlab.dist
  • python312Packages.dalle-mini
  • python312Packages.dalle-mini.dist
  • python312Packages.deepface
  • python312Packages.deepface.dist
  • python312Packages.distrax
  • python312Packages.distrax.dist
  • python312Packages.dm-haiku
  • python312Packages.dm-haiku.dist
  • python312Packages.edward
  • python312Packages.edward.dist
  • python312Packages.elegy
  • python312Packages.elegy.dist
  • python312Packages.evosax
  • python312Packages.evosax.dist
  • python312Packages.flax
  • python312Packages.flax.dist
  • python312Packages.flowmc
  • python312Packages.flowmc.dist
  • python312Packages.gpt-2-simple
  • python312Packages.gpt-2-simple.dist
  • python312Packages.imgcat
  • python312Packages.imgcat.dist
  • python312Packages.keras
  • python312Packages.keras.dist
  • python312Packages.mhcflurry
  • python312Packages.mhcflurry.dist
  • python312Packages.mtcnn
  • python312Packages.mtcnn.dist
  • python312Packages.objax
  • python312Packages.objax.dist
  • python312Packages.oryx
  • python312Packages.oryx.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
  • python312Packages.pytensor
  • python312Packages.pytensor.dist
  • python312Packages.retinaface
  • python312Packages.retinaface.dist
  • python312Packages.rlax
  • python312Packages.rlax.dist
  • python312Packages.tensorflow
  • python312Packages.tensorflow-build
  • python312Packages.tensorflow-build.dist
  • python312Packages.tensorflow-probability
  • python312Packages.tensorflow-probability.dist
  • python312Packages.tensorflow.dist
  • python312Packages.tensorflowWithoutCuda
  • python312Packages.tensorflowWithoutCuda.dist
  • python312Packages.tf-keras
  • python312Packages.tf-keras.dist
  • python312Packages.tf2onnx
  • python312Packages.tf2onnx.dist
  • python312Packages.tflearn
  • python312Packages.tflearn.dist
  • python312Packages.treex
  • python312Packages.treex.dist
  • python312Packages.vqgan-jax
  • python312Packages.vqgan-jax.dist
  • tests.pkg-config.defaultPkgConfigPackages.tensorflow
  • witnessme
  • witnessme.dist
  • wyoming-openwakeword
  • wyoming-openwakeword.dist
❌ 46 packages failed to build:
  • python311Packages.bambi
  • python311Packages.bambi.dist
  • python311Packages.baselines
  • python311Packages.baselines.dist
  • python311Packages.deepface
  • python311Packages.deepface.dist
  • python311Packages.distrax
  • python311Packages.distrax.dist
  • python311Packages.dm-haiku
  • python311Packages.dm-haiku.dist
  • python311Packages.edward
  • python311Packages.edward.dist
  • python311Packages.evosax
  • python311Packages.evosax.dist
  • python311Packages.flax
  • python311Packages.flax.dist
  • python311Packages.flowmc
  • python311Packages.flowmc.dist
  • python311Packages.gpt-2-simple
  • python311Packages.gpt-2-simple.dist
  • python311Packages.imgcat
  • python311Packages.imgcat.dist
  • python311Packages.keras
  • python311Packages.keras.dist
  • python311Packages.mtcnn
  • python311Packages.mtcnn.dist
  • python311Packages.oryx
  • python311Packages.oryx.dist
  • python311Packages.pymc
  • python311Packages.pymc.dist
  • python311Packages.pytensor
  • python311Packages.pytensor.dist
  • python311Packages.retinaface
  • python311Packages.retinaface.dist
  • python311Packages.rlax
  • python311Packages.rlax.dist
  • python311Packages.tensorflow (python311Packages.tensorflow-build ,python311Packages.tensorflowWithoutCuda)
  • python311Packages.tensorflow.dist (python311Packages.tensorflow-build.dist ,python311Packages.tensorflowWithoutCuda.dist)
  • python311Packages.tensorflow-probability
  • python311Packages.tensorflow-probability.dist
  • python311Packages.tf-keras
  • python311Packages.tf-keras.dist
  • python311Packages.tflearn
  • python311Packages.tflearn.dist
  • python311Packages.vqgan-jax
  • python311Packages.vqgan-jax.dist

@boltzmannrain
Copy link
Contributor

aarch64-linux hash

$ nix-build --system aarch64-linux -A python312Packages.tensorflowWithCuda
...
error: hash mismatch in fixed-output derivation '/nix/store/dkh4r650lvmkwgc1vgbnn61gdwpiif0k-tensorflow-gpu-2.14.0-deps.tar.gz.drv':
                specified: sha256-AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=
                   got:    sha256-9Al7JH93Q7D0xN5sjtk5VvZH+ge13nnMJOC8Py5f96g=

@boltzmannrain
Copy link
Contributor

Got local mismatch without cuda

$ nix-build --system aarch64-linux -A python312Packages.tensorflow -j0
...
error: hash mismatch in fixed-output derivation '/nix/store/icicrg8manx86yywyyf0d833ckxnb9za-tensorflow-2.14.0-deps.tar.gz.drv':
                specified: sha256-ktEpU1YyedNpssuJTqsqS+XeY5NFNFnH1fuHsm4NRSY=
                   got:    sha256-85xKq/gKO9Klt56OBCowTFhYvz+61vSofODFGUio17s=

it is possible to download ofborg-built outputs?

@zeuner
Copy link
Contributor Author

zeuner commented Nov 7, 2024

Thanks, learned something new. I "enabled" cudaSupport by building tensorflowWithCuda before, which did not trigger this. Should be fixed now.

Yes, they are slightly different. tensorflowWithCuda only overrides the cudaSupport argument for the tensorflow package, while enabling cudaSupport globally will affect the entire nixpkgs package set.

Yes... in our case, the thing is that cudaCapabilities is currently conditionalized on config.cudaSupport, so it doesn't pick up cudaPackages.cudaFlags.cudaCapabilities when building as tensorflowWithCuda, but it does so when globally setting the config flag (https://github.com/NixOS/nixpkgs/pull/272838/files#diff-3f9c997aafe20e8949648d4babbf03af7c4864c517b7cf3611d6a6e42610257aL74).

Not sure whether this is sensible, though. Maybe it slipped through when I considered the global push for preferably using cudaSupport from config instead of overrides. And maybe it's better to have the same behaviour regarding cudaCapabilities no matter how cudaSupport got enabled.

@zeuner
Copy link
Contributor Author

zeuner commented Nov 7, 2024

  • python311Packages.shimmy

These confuse me a bit. AFAICS, python3Packages.shimmy does not depend on python3Packages.tensorflow or python3Packages.keras (the packages being touched by this PR), so I'm not sure what I could do about it. Am I missing something here?

@zeuner
Copy link
Contributor Author

zeuner commented Nov 7, 2024

Got local mismatch without cuda

$ nix-build --system aarch64-linux -A python312Packages.tensorflow -j0
...
error: hash mismatch in fixed-output derivation '/nix/store/icicrg8manx86yywyyf0d833ckxnb9za-tensorflow-2.14.0-deps.tar.gz.drv':
                specified: sha256-ktEpU1YyedNpssuJTqsqS+XeY5NFNFnH1fuHsm4NRSY=
                   got:    sha256-85xKq/gKO9Klt56OBCowTFhYvz+61vSofODFGUio17s=

it is possible to download ofborg-built outputs?

Good question!

@NixOS/infra any ideas regarding this?

@zeuner
Copy link
Contributor Author

zeuner commented Nov 10, 2024

aarch64-linux hash

$ nix-build --system aarch64-linux -A python312Packages.tensorflowWithCuda
...
error: hash mismatch in fixed-output derivation '/nix/store/dkh4r650lvmkwgc1vgbnn61gdwpiif0k-tensorflow-gpu-2.14.0-deps.tar.gz.drv':
                specified: sha256-AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=
                   got:    sha256-9Al7JH93Q7D0xN5sjtk5VvZH+ge13nnMJOC8Py5f96g=

Thanks, added.

@zeuner
Copy link
Contributor Author

zeuner commented Nov 10, 2024

  • python311Packages.shimmy

These confuse me a bit. AFAICS, python3Packages.shimmy does not depend on python3Packages.tensorflow or python3Packages.keras (the packages being touched by this PR), so I'm not sure what I could do about it. Am I missing something here?

I could also build it here on with this PR merged.

@zeuner
Copy link
Contributor Author

zeuner commented Nov 17, 2024

Figured out that pypi_psutil led to the deps hashes being unstable on aarch64-linux. They need to be recomputed now, but should hopefully be stable afterwards.

@FliegendeWurst
Copy link
Member

ofborg reports the hash to be sha256-KXSbqwZpN4Im32St0ADyIc4N5/SQfiQPDoLu9bXbckY=.

@zeuner
Copy link
Contributor Author

zeuner commented Sep 21, 2025

The CI might require merging #437407 before.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

2.status: merge conflict This PR has merge conflicts with the target branch 6.topic: python Python is a high-level, general-purpose programming language. 8.has: package (new) This PR adds a new package 10.rebuild-darwin: 1-10 This PR causes between 1 and 10 packages to rebuild on Darwin. 10.rebuild-linux: 1-10 This PR causes between 1 and 10 packages to rebuild on Linux.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants